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Abstract 

The  RV  Applications  Program  (RVAP), 
was  initiated  in  19M-95  by  the  ICBM  System 
Program  Office,  with  Lockheed  Martin  Missiie  & 
Space  (LMMS)  as  a  participant,  to  evaiuate  the 
status  of  the  US  industriai  base  for  sustainment 
of  silo-based  ICBM  reentry  systems  (RS).  The 
elements  of  the  activities  (skills,  products,  test 
facilities)  required  for  the  engineering,  production 
and  operational  phases  of  an  RS  were  compiled. 
An  evaluation  process  was  developed  to  screen 
these  elements  for  those  critical  for  sustainment 
of  the  industrial  base.  The  LMMS  evaluation 
selected  half  of  the  approximately  100  identified 
activities  as  critical.  This  paper  describes  the 
process  of  identifying  the  activity  elements  and 
lists  them.  It  then  describes  the  evaluation 
process  and  lists  the  results. 

Nomenclature 

ATE  =  Activity  Tree  Element 
C/C  =  carbon/carbon 
EMD  =  Engineering,  Manufacturing  & 
Development 

EPI  =  Engineering  Process  Improvement 
ICBM  Intercontinental  Ballistic  Missile 
IPT  =  Integrated  Product  Team 
NSWC  -  Naval  Surface  Warfare  Center 
OT&E  =  Operational  Test  &  Evaluation 
RB  =  reentry  body  (USN) 

RS  =  reentry  system 
RV  =  reentry  vehicle  (USAF) 

RVAP  =  Reentry  Vehicle  Applications  Program 
SEMP  «  Systems  Engineering  Management  Plan 

I.  Background 

The  Minuteman  III  Missile  system  was 
initially  deployed  in  1969-1972  with  the  Mk12 
reentry  vehicle  (RV).  A  partial  retrofit  with  the 
Mk12A  RV  was  carried  out  in  1979-82.  Peace¬ 
keeper,  the  newest  USAF  ICBM,  was  deployed 
in  the  late  1980's  and  includes  the  Mk21  RV  in 
its  reentry  system  (RS).  There  are  continuing 
Operational  Test  and  Evaluation  (OT&E)  flights 
for  both  missiles,  but  manufacturing  of  reentry 
systems  for  the  AF  has  ceased.  This  was 
preceded  by  discontinuance  of  any  major 
Engineering,  Manufacturing  &  Development 
(EMD)  phase  work.  The  EMD  phase  exercised 


many  missiles  and  science  engineering  skills 
and  test  facilities  which  are  unique,  or  very 
nearly  so,  to  ICBM  RS  work.  The  manufactur¬ 
ing  phase  also  used  skills,  facilities  and  (in 
particular)  materials  not  available  in  other 
aerospace  or  defense  systems. 

In  1 994,  the  USAF  initiated  the  Reentry 
Vehicle  Application  Program  (RVAP)  to  assess 
the  status  of  the  land  silo-based  reentry  system 
ICBM  industrial  base.  This  ps^er  describes  the 
work  done  by  LMMS,  the  methodology  devel¬ 
oped  and  the  results  of  that  assessment. 
These  results  were  one  input  used  by  the 
USAF  to  define  the  subsequent  activities  in 
RVAP. 

II  Approach 

2.0  Activity  Trees 

2.1  Derivation  and  Description  of 
The  Complete  Activity  Trees 

The  end  item  sought  in  this  activity  was  the 
identification  and  compilation  of  those  items 
which  must  be  maintained  in  order  to  assure  a 
viable  industrial  base  for  maintaining  reentry 
systems  capability.  Our  overall  process  for 
accomplishing  this  is  shown  in  Figure  1 . 

One  of  the  first  tasks  undertaken  on  this  pro¬ 
gram  was  to  formally  identify  and  list  the  activity 
tree  elements  (ATE’s)  that  comprise  the  ICBM 
reentry  system  industrial  base.  The  term 
"Activity  Tree  Element"  was  derived  from  the 
definition  of  an  "Activity  Tree"  contained  in  the 
document  "Reentry  Vehicle  Industrial  Base 
Assessment,  Cookbook  for  Implementation"  (1) 
as  the: 

Definition  of  all  activities  necessary  to 
carry  out  a  Production/Deployment  Pro¬ 
gram  ..  (and)  ..  an  Operation  &  Support 
Program. 

As  depicted  in  Figure  1  a  dedicated  team  of 
specialists  is  convened  as  an  Integrated 
Product  Team,  These  specialists  synthesize 
an  overall  list  of  ATE's  which  are  then  operated 
on  in  a  formalized  process. 


*  This  work  was  performed  under  USAF  Contract  No.  F4261 0-95-D-0026  for  Air  Force  Materiai 
Command,  Hill  AFB,  UT 
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Abstract 

The  RV  Applications  Program  (RVAP), 
was  initiated  in  1994-95  by  the  ICBM  System 
Program  Office,  with  Lockheed  Martin  Missile  & 
Space  (LMMS)  as  a  participant,  to  evaluate  the 
status  of  the  US  industrial  base  for  sustainment 
of  silo-based  ICBM  reentry  systems  (RS).  The 
elements  of  the  activities  (skiiis,  products,  test 
facilities)  required  for  the  engineering,  production 
and  operationai  phases  of  an  RS  were  compiled. 
An  evaluation  process  was  developed  to  screen 
these  elements  for  those  critical  for  sustainment 
of  the  industrial  base.  The  LMMS  evaluation 
seiected  half  of  the  approximately  100  identified 
activities  as  criticai.  This  paper  describes  the 
process  of  identifying  the  activity  eiements  and 
iists  them.  It  then  describes  the  evaluation 
process  and  iists  the  results. 

Nomenclature 

ATE  =  Activity  Tree  Element 
C/C  =  carbon/carbon 
EMD  =  Engineering,  Manufacturing  & 
Deveiopment 

EPi  =  Engineering  Process  improvement 
iCBM  =  Intercontinental  Ballistic  Missiie 
IPT  =  Integrated  Product  Team 
NSWC  =  Naval  Surface  Warfare  Center 
OT&E  =  Operational  Test  &  Evaluation 
RB  =  reentry  body  (USN) 

RS  =  reentry  system 
RV  =  reentry  vehicie  (USAF) 

RVAP  =  Reentry  Vehicle  Applications  Program 
SEMP  =  Systems  Engineering  Management  Pian 

I.  Background 

The  Minuteman  III  Missile  system  was 
initially  deployed  in  1969-1972  with  the  Mk12 
reentry  vehicie  (RV).  A  partial  retrofit  with  the 
Mk12A  RV  was  carried  out  in  1979-82.  Peace¬ 
keeper,  the  newest  USAF  ICBM,  was  deployed 
in  the  late  1 980's  and  includes  the  Mk21  RV  in 
its  reentry  system  (RS).  There  are  continuing 
Operationai  Test  and  Evaluation  (OT&E)  flights 
for  both  missiles,  but  manufacturing  of  reentry 
systems  for  the  AF  has  ceased.  This  was 
preceded  by  discontinuance  of  any  major 
Engineering,  Manufacturing  &  Development 
(EMD)  phase  work.  The  EMD  phase  exercised 


many  missiles  and  science  engineering  skills 
and  test  facilities  which  are  unique,  or  very 
nearly  so,  to  ICBM  RS  work.  The  manufactur¬ 
ing  phase  also  used  skills,  facilities  and  (in 
particular)  materials  not  available  in  other 
aerospace  or  defense  systems. 

In  1 994,  the  USAF  Initiated  the  Reentry 
Vehicle  Application  Program  (RVAP)  to  assess 
the  status  of  the  land  silo-based  reentry  system 
ICBM  industrial  base.  This  paper  describes  the 
work  done  by  LMMS,  the  methodology  devel¬ 
oped  and  the  results  of  that  assessment. 
These  results  were  one  input  used  by  the 
USAF  to  define  the  subsequent  activities  in 
RVAP. 

ii  Approach 

2.0  Activity  Trees 

2.1  Derivation  and  Description  of 
The  Complete  Activity  Trees 

The  end  item  sought  in  this  activity  was  the 
identification  and  compiiation  of  those  items 
which  must  be  maintained  in  order  to  assure  a 
viable  industrial  base  for  maintaining  reentry 
systems  capabiiity.  Our  overaii  process  for 
accompiishing  this  is  shown  in  Figure  1 . 

One  of  the  first  tasks  undertaken  on  this  pro¬ 
gram  was  to  formaily  identify  and  iist  the  activity 
tree  elements  (ATE's)  that  comprise  the  ICBM 
reentry  system  industrial  base.  The  term 
"Activity  Tree  Eiement"  was  derived  from  the 
definition  of  an  "Activity  Tree"  contained  in  the 
document  "Reentry  Vehicle  Industrial  Base 
Assessment,  Cookbook  for  Implementation"  (1 ) 
as  the; 

Definition  of  all  activities  necessary  to 
carry  out  a  Production/Deployment  Pro¬ 
gram  ..  (and)  ..  an  Operation  &  Support 
Program. 

As  depicted  in  Figure  1  a  dedicated  team  of 
specialists  is  convened  as  an  Integrated 
Product  Team.  These  specialists  synthesize 
an  overall  list  of  ATE's  which  are  then  operated 
on  in  a  formalized  process. 
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We  categorized  the  potential  ATE's  into 
four  types  of  activity: 

Engineering  skills 

Products  (including  manufacturing 

skills)/processes/materials 

Test  facilities 

Documentation 

In  this  paper,  the  identified  ATE's  are 
written  with  capital  first  letters  and  italicized; 
e.g.  Reentry  System  Engineer  is  a  skill, 
Carbon/Carbon  Nosetip  Billet  is  a 
material/product,  HIPiC  Preform  Densificatlon  a 
process  or  production  facility.  Reentry  System 
Test  Set  is  a  test  facility  and  National  Archives 
is  captured  in  the  Documentation  category. 

We  considered  the  reentry  system 
lifecycle  in  three  phases.  The  Engineering  and 
Manufacturing  Development  (EMD)  phase  is 
chronologically  the  first.  It  is  the  one  most 
closely  identified  with  high  technology  engineer¬ 
ing  and  design  effort.  It  also  requires  the  use  of 
special  test  facilities,  including  fiight  test,  and 
access  to  past  documentation  of  technoiogy 
and  design  work.  It  also  calls  for  detailed 
documentation  of  the  work  done  in  this  phase. 

The  Production  &  Deployment  phase 
makes  most  intensive  use  of  component  parts 
and  materials  and  processes,  while  also 
requiring  selective  continuing  use  of 
engineering  talent  for  review  of  processes  and 
evaluation  of  the  effects  of  specification  and 
manufacturing  procedure  changes.  It  is 
important  that  these  revisions  be  properly 
documented  in  the  manufacturing  data  base. 
Test  facilities  aiso  continue  to  be  used  in  this 
phase. 

In  the  Operational  Test  &  Evaluation 
fOT&E)  phase,  continuing  flight  mechanics 
engineering  services  such  as  Analyses  of 
Reentry  Flight  Dynamics  and  Accuracy  are  also 
provided  for  the  OT&E  flight  tests  which 
continue  throughout  the  deployed  lifecycle  of 
the  RS.  Also  included  are  the  maintenance 
and  revision  of  test  equipment  such  as  Radar 
Range  Simulators,  all  the  more  so  in  recent 
years  as  service  life  is  stretched  well  beyond 
original  expectations.  Various  engineering 
skills  usually  associated  with  the  deveiopment 
phase  are  occasionally  required. 

Our  approach  to  developing  the  list  of 
ATE's  was  initially  to  brainstorm  with  the  RVAP 
Integrated  Product  Team  at  our  company  and 


collect  their  joint  compilations.  Table  1,  "RS, 
RV/RB  and  Fuze  Activity  Tree  Identification" 
displays  some  of  the  sources  of  this  information 
by  lifecycle  phase  and  gives  examples  that 
readily  came  to  mind. 

The  list  of  all  Activity  Tree  Elements 
identified  by  this  process  is  given  in  Tables  2 
through  4  for  the  EMD,  Production  and  OT&E 
phases,  respectively.  Note  that  the  ATE's  are 
grouped  by  the  same  technical  disciplines 
(Systems,  Aerothermostructural,  Materials  . . .) 
as  the  discipline  makeup  of  our  IPT  (Figure  1). 

2.2  Discussion  of  Activity  Tree  and 
ATE  Characteristics 

We  have  observed  that  the  sources  for 
identification  of  the  ATE's  appear  to  be  better 
documented  for  the  Production  &  Deployment 
and  OT&E  phases  than  for  the  Engineering  & 
Manufacturing  phase.  There  are  drawing  trees, 
materials  and  process  specification  trees,  parts 
lists,  manufacturing  standing  instructions  and 
other  highly  standardized  descriptions  for  the 
manufacturing  process.  Similar  detailed 
planning  exists  for  the  OT&E  phase. 

In  the  case  of  the  Production  phase 
callout  of  the  various  components  via  drawing 
trees,  we  chose  in  most  cases  to  designate  the 
ATE's  at  the  subsystem  level  only.  For 
example,  the  fuze  and  other  RV  electrical 
subsystems  are  called  out  as  Hardened 
Electrical  Power  Supplies/Batteries,  Digital  S/S, 
Analog  S/S,  etc.  To  attempt  to  enumerate 
every  drawing  tree  and  parts  list  element  of  the 
subsystems  would  not  have  served  any  valid 
purpose  for  this  program.  However,  the 
importance  of  certain  classes  of  components 
was  recognized  by  ATE  callouts  such  as 
Hardened  Electrical  Parts,  Fuze  Components 
and  Cables. 

Similarly  for  the  materials  ATE’s,  we  cite 
ESM  Aft  Cover  Heatshield  Material  and 
Hardened  Composite  Antenna  Window  Material 
at  this  "top"  subsystem  level,  without  reference 
to  the  many  component  materials  and  process 
specifications  which  are  key  to  production  of 
RV  component  parts  from  these  materials. 

Consider,  however,  another  set  of  related 
materials  ATE  citations  for  the  specs  underlying 
production  of  the  Carbon/Carbon  Nosetip  Billet 
cited  as  an  example  in  Table  1:  i.e.  HIPIC 
Preform  Densificatlon  and  3D  Graphite  Fiber 
Preform  Weaving  (both  process  and  facility 
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specs)  and  Coal  Tar  Pitch  and  Graphite  Yarn, 
1000/3000  Filament  (materials  component 
specs).  This  is  a  relatively  comprehensive  call¬ 
out  of  materials  and  process  specifications, 
absent  the  top  level  drawing  callout  for  the 
fabrication  of  the  Carbon/Carbon  Nosetip  itself 
from  the  C/C  Nosetip  Billet  Another  example 
from  Table  1  is  the  "Rayon  Fiber  for  Tape 
Wrapped  Carbon  Phenolic  Heatshield."  We 
have  to  some  degree  therefore  anticipated  the 
importance  of  calling  out  certain  ATE's  at 
subsystem  and  component  levels  for 
recognition  in  an  "unbundled"  way  in  the 
subsequent  Critical  Attribute  Assessment 
process. 

Compared  to  the  Production  and  O&S 
phases,  the  Engineering  phase  has  not  been 
standardized  to  this  degree,  despite  such 
provisions  as  Systems  Engineering 
Management  Plans  (SEMP)  and  Configuration 
Management  Military  Standards.  In  recent 
years  aerospace  firms  have  implemented 
surveys  and  institutionalization  of  "best 
practices"  in  certain  design  technology  areas, 
notably  electronic  parts  and  circuit  engineering. 
At  Lockheed  Martin  (Air  Force  Reentry 
Systems  Programs)  and  previously  at  GE 
Reentry  Systems,  the  "Engineering  Process 
Improvement"  (EPI)  program  was  developed  to 
achieve  this  aim,  and  this  practice  has  been 
sustained  and  institutionalized  in  our  docu¬ 
mentation  and  software  procedures.  The 
Integrated  Product  Team  (IPT)  is  one  such  EPI 
practice  for  coordination  of  the  various  technical 
disciplines  over  the  various  phases  of  a 
program.  Concurrent  Engineering  is  another 
generic  contemporary  approach  to  assuring 
coordination  of  the  phases  of  a  program. 
However,  there  is  no  standardized/docu¬ 
mented/comprehensive  approach  to  the  design 
of  reentry  systems  or  their  reentry  vehicle  and 
fuze  subsystems. 

The  compilation  of  the  ATE  list 
proceeded  to  preparation  of  the  "Evaluation 
Form"  for  each  ATE  by  assigned  IPT  members. 
This  process  created  a  detailed  analysis  of  the 
ATE's  that  had  been  identified  thus  far  and  also 
highlighted  gaps  and  overlaps  in  the  activity 
tree  coverage  that  were  substantially  ironed  out 
in  the  process. 

3.0  Assessment  Methodology 

This  section  describes  the  process  and 
format  which  we  developed  and  used  to  assess 
the  need  for  government  sustainment  action 


with  regard  to  the  set  of  USAF  silo-based  ICBM 
reentry  system  activity  tree  elements  (ATE's). 

3.1  Description  of  Methodology 

Our  Assessment  methodology  grew  out 
of  an  approach  developed  at  NSWC  and 
Sandia  and  described  in  the  document 
"Reentry  Vehicle  Industrial  Base  Assessment, 
Cookbook  for  Implementation"  previously  cited 
as  (1).  We  used  the  activity  tree  definition 
approach,  distinguishing  among  the  three 
phases  of  the  RS  lifecycle. 

3.1.1  Classification  of  ATE's  bv 
Category  and  Effect  on 
Assessment  Process 

The  "Cookbook"  defined  three  "Capabilities": 
Vendors,  Test  Facilities,  and  Engineering. 
These  were  also  subsequently  referred  to  as 
"Categories".  The  four  analogous  Categories 
that  we  defined  are: 

Engineering  skills 
Products/processes/materials 
Test  facilities 
Documentation 

The  Engineering  Skills  and  Test  Facilities 
categories  used  for  this  analysis  are  the  same 
as  those  used  in  the  "Cookbook"  -  i.e.  the 
definition  of  the  categories,  not  the  actual  list  of 
ATE's  developed  under  them. 

However,  rather  than  use  the  category  of 
Vendors,  we  have  identified  for  assessment  the 
vendors'  actual  output  -  products  and  materials 
-  and  the  processes  and  facilities  for  producing 
them.  This  is  considered  to  be  a  more  robust 
and  fundamental  approach.  Robust  because 
the  vendor  industrial  base  may  change,  even 
disappear  -  this  is  the  purpose  for  the  RVAP 
programs'  initiation.  Fundamental  because 
analysis  in  terms  of  the  specified  reentry 
system  materials  and  products  (components, 
subsystems)  identifies  the  requirements  for  the 
generic  processes  and  manufacturing  facilities. 
The  powerful  microeconomic  mechanism  of  the 
substitution  effect  can  then  be  introduced  into 
the  analysis  via  consideration  of  such 
assessment  criteria  as  uniqueness  and 
availability. 

In  addition  to  the  three  categories  used  in 
the  NSWC/Sandia  cookbook,  we  have  also 
introduced  a  new  and  fourth  one: 
Documentation.  This  category  is  obviously  an 


implicit  function  within  the  engineering  skill 
category  and  it  Is  both  utilized  by  and 
generated  in  the  production  and  test-oriented 
categories.  However,  we  observed  repeatedly 
in  the  beginning  of  this  work  that  explicit 
references  to  the  various  records  and  directions 
for  performing  the  work  of  the  reentry  system 
lifecycle  phases  repeatedly  surfaced  in  our 
attempts  to  describe  and  assess  the  processes. 

The  production  phase  for  example  has 
drawing  trees:  the  drawings  themselves,  the 
underlying  manufacturing  instructions  and 
material  and  process  specifications.  These 
documents  are  distinctly  different  from  the 
materials,  products  and  manufacturing  facilities 
themselves,  although  they  might  be  considered 
as  implicit  within  the  "process"  category 
concept. 

Similarly,  the  operations  of  the  OT&E 
phase  are  documented  formally  in  Tech 
Orders,  the  Operations  Plan  and  in  the 
Operations  History. 

Consideration  of  the  EMD  phase, 
however,  showed  that  far  less  formal 
documentation  exists  for  this  high  engineering 
skill-intense  portion  of  the  reentry  system 
lifecycle.  In  working  sessions  to  develop  the 
ATE's  and  to  develop  this  assessment 
methodology,  the  term  "corporate  memory" 
repeatedly  arose  when  documentation  was 
sought  for  the  formal  methods  of  performing 
reentry  system  design,  the  underlying  analytic 
methods  and  the  data  bases  of  materials 
properties.  This  situation  is  portrayed  in  Table 
1.  The  need  for  a  separate  category  for 
Documentation  was  therefore  evidenced. 

3.1.2  Description  of  Development 

of  Assessment  Criteria  and  Scoring 

Procedure 

Our  goal  was  to  develop  a  simple,  user- 
friendly  assessment  process  using  the 
NSWC/Sandia  Cookbook  as  a  guide.  It  was 
also  an  objective  to  quantify  the  process, 
employing  uniform  scoring  criteria  to  reduce 
subjectivity.  The  Cookbook  was  formulated  to 
be  quantitative.  However,  after  review  by  our 
Integrated  Product  Team  leaders,  we  found 
that  strict  adherence  to  the  Cookbook  format 
would  have  required  a  very  intensive  training  of 
our  team  personnel  in  assigning  the  large 
number  of  required  weighting  factors  and 
adhering  to  the  scoring  procedures  as  called  for 
in  that  process.  Assuming  that  this  training 


were  100%  successful,  we  also  feared  that  the 
team  corporate  memory  of  it  would  be  volatile 
and  present  problems  with  regard  to  the 
uniformity  of  application,  even  within  the  time 
span  of  this  program. 

Another  consideration  was  that  the 
Cookbook  process  called  for  a  large  number  of 
evaluation  criteria  for  each  ATE.  Our  initial 
attempts  to  apply  the  format  for  the  EMD  phase 
invited  modifications  and  additions  as  different 
team  members  attempted  to  use  it.  This  raised 
the  question  of  normalization  of  scores;  if  we 
had  more  evaluation  criteria  for  one  phase  than 
another  or  for  one  category  -  products  versus 
skills  -  bias  would  be  inherent  to  the  process. 

Therefore,  in  the  interest  of  using  our 
program  resources  with  economy  and 
promoting  maximum  possible  coherence  within 
the  team  approach,  it  was  decided  to  adapt  the 
Cookbook  concept,  keeping  its  principal 
assessment  criteria  and  sensitivities  but 
seeking  improved  user-friendliness  and  internal 
consistency. 

The  elements  of  the  assessment  process 
that  we  developed  are  shown  in  Figure  2; 
"Assessment  Process  Flow".  First,  the  list  of 
Activity  Tree  Elements  from  the  RS,  RV  and 
fuze  is  compiled.  The  sources  and  Categories 
of  these  are  indicated.  Then  three  sets  of 
assessment  criteria  are  applied. 

The  first  assessment  criterion  is 
Uniqueness  and  it  is  applied  as  an  unscored 
go/no  filter.  The  criteria  for  evaluation  are 
shown  in  Figure  3.  Uniqueness  is  ascribed  at 
two  levels:  unique  to  DoD  utilization  or  the 
more  unique  case  of  utilization  only  for  reentry 
system  applications.  Our  original  instructions 
to  the  evaluators  included  the  consideration  of 
a  special  category  of  items  becoming  no  longer 
available,  e.g.  as  a  consequence  of  having 
been  unique/special  purpose  for  RV  use  only. 
However,  this  distinction  generally  was  not 
applied  -  the  Availability/Affordability  filter  was 
used  for  this  aspect  of  the  assessment. 

The  Evaluation  Team  used  an  ATE 
Evaluation  Form  which  had  been  prepared  for 
this  purpose,  see  Figures  4A  and  4B,  the  two 
sides  of  the  actual  forms  used.  The  ATE  is 
indicated  to  be  either  unique  or  non-unique. 
Space  is  provided  for  the  rationale. 

The  next  assessment  criterion  is 
Criticality.  This  evaluation  is  done  on  two 
levels.  First  was  the  criticality  of  the  ATE  to  the 
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mission,  scored  1  to  10,  foilowed  by  the 
Probability  of  Need,  also  1  to  10,  for  a 
combined  possible  score  of  20  in  this 
evaluation  criterion.  The  set  of  detailed 
"Criticality  Assessment  Scoring  Criteria"  is 
shown  as  Figure  5. 

Criticality  itself  is  evaluated  in  terms  of  its 
impact  on  the  mission,  with  four  bracketed 
ranges  of  importance,  the  scoring  in  those 
brackets  to  be  allotted  proportional  to  the 
reviewer's  perception  of  the  need,  normalized 
to  the  other  ATE  evaluations.  However,  the 
scoring  for  the  additional  consideration  of 
Probability  of  Need  was  to  be  proportional  to 
the  degree  that  the  combined  statements  in  an 
entry  field  was  perceived  to  apply  to  the  ATE. 
In  this  manner  the  time  factor  for  need  was 
explicitly  addressed,  accounting  for  the 
possibility  that  an  ATE,  no  matter  how  critical 
its  role  in  a  USAF  ICBM  reentry  system,  might 
not  be  needed  for  a  long  time;  or  alternatively, 
even  If  its  function  were  not  that  critical  per  se, 
replacement  might  be  required  in  the  near 
future,  thereby  raising  the  indicated  (combined) 
Criticality  assessment  score. 

The  third  and  final  evaluation  criterion  is 
Availabilitv/Affordabilitv.  This  was  the  most 
difficult  criterion  combination  for  which  to  set  up 
a  consistent  scoring  scheme.  It  was  realized 
that  most  of  the  difficulty  originated  from  the 
differing  Category  types,  e.g.  products  versus 
skills.  Our  study  of  the  Cookbook  approach 
which  was  detailed  for  products  only  (in  the 
version  we  had)  helped  point  the  way  to  a 
appropriate  screen  for  each  category. 

Figure  6  shows  the  scheme  for  Products 
(and  Materials,  Processes  and  Production 
Facilities).  There  are  three  screens,  each  with 
a  maximum  possible  score  of  10. 

Current/Projected  Capability  measures 
availability  in  terms  of  several  parameters 
including  the  current  status,  the  likelihood  that  it 
can  be  reconstituted,  the  availability  of  key 
personnel  and  capability  at  the  suppliers,  the 
likelihood  of  alternates  that  can  be  qualified  and 
substituted  for  the  original  product  and  other 
factors  such  as  environmental  regulations. 
Note  that  the  highest  scores  are  accorded  for 
the  least  availability. 

The  next  screen  is  Affordability.  The 
guidelines  in  Figure  3-6  treat  the  degree  of 
"unaffordability"  in  terms  of  the  ratio  of  the  cost- 
to-reconstitute  to  the  cost-to-sustain.  Again, 


the  most  serious  condition  receives  the  highest 
score. 

The  third  screen  is  Availability  Lead 
Time.  Immediate  or  just-in-time  availability  for 
the  anticipated  program  lead  time  is  accorded 
the  lowest  score.  The  condition  in  which  the 
product  can  be  reconstituted,  but  at  much  delay 
to  the  program  requirement,  is  accorded  the 
maximum  score,  9-10.  Note  that  the  drastic 
condition  of  never  again  being  available  is 
separated  out  here  and  reserved  for  the  first 
parameter  of  this  screen,  i.e.  the 
Current/Projected  Capability. 

The  possible  scoring  under  this  criterion's 
combined  set  of  three  criterion  screens  is  a 
maximum  of  30.  This  score  would  be  entered 
on  the  ATE  Evaluation  Form  (Figure  4A  and 
4B)  along  with  any  comments  or  reservations. 

Similarly,  Availability/Affordability 
evaluations  were  performed  on  the  ATE's  in  the 
Categories  of  Skills  and  Test  Facilities.  The 
scoring  schemes  for  these  categories  are 
omitted  from  this  paper  for  the  sake  of  a 
reasonable  brevity. 

This  overall  Activity  Tree  Assessment 
Process  is  shown  in  Figure  7.  The  three  filters 
are  seen  as  an  initial  Uniqueness  unscored 
go/no-go  gate,  followed  by  two  scored 
combination  filters  in  parallel.  In  addition  to  the 
quantitative  scoring  within  each  of  these  two 
filters,  a  voting  criterion  was  also  applied  to  the 
combination  of  the  two. 

In  this  final  filter  voting  process,  an  ATE 
candidate  which  has  received  half  or  more  of 
the  potential  scores  under  the  Criticality 
evaluation  (10  or  more)  and  Availability/ 
Affordability  (15  or  more)  is  rated  as  a 
candidate  for  sustainment  or  a  "Critical 
Attribute".  An  ATE  not  satisfying  this  criterion, 
but  which  has  received  a  score  of  8  or  more  in 
any  assessment  criterion,  is  rated  as  requiring 
additional  review,  regardless  of  total  score. 
ATE's  not  meeting  either  of  these  criteria  are 
rated  as  not  a  candidate  for  sustainment. 

4.0  Results 

The  Activity  Tree  Elements  (ATE's)  iden¬ 
tified  by  the  IPT=  and  presented  in  Section  2 
were  individually  assessed  using  the  methodol¬ 
ogy  outlined  above  in  Section  3.  The  mecha¬ 
nism  for  accomplishing  this  evaluation  was  for 
the  cognizant  member  of  the  team  to  fill  out  an 
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Element  Evaluation  Form  for  each  identified 
ATE  containing  a  brief  rationale  and  scoring  for 
it.  An  example  of  a  completed  form  is  shown  in 
Figure  8.  These  assessment  sheets  were  the 
basis  for  ranking  the  ATE's  as  to  whether  they 
should  be  sustained,  reviewed  or  not  sustained 
(no  action).  The  resulting  rankings  are  delin¬ 
eated  for  all  of  the  ATE's  in  Table  5  through  7. 
These  charts  respectively  address  the  relevant 
ATE's  for  the  three  program  phases:  EMD, 
Production  and  O&S.  The  ATE's  are  grouped 
according  to  technology  area:  Systems, 
Aerothermostructural,  etc.,  and  are  ranked  S 
(Sustainment  Candidate),  R  (Additional 
Review),  and  NA  (No  Action). 

A  number  of  the  ATE's  are  carried 
through  more  than  one  program  phase,  with 
many  existing  in  all  three  phases.  For  instance. 
Hypersonic  Aerodynamics  and  Heatshield 
Performance  and  Design  are  primarily  required 
in  the  EMD  phase  of  a  program,  but  are  also 
skills  that  are  needed  in  the  Production  and 
O&S  phases  in  order  to  consult  upon  and 
evaluate  any  manufacturing  variation  or 
observed  off-nominal  flight  test  behavior.  Other 
ATE's  such  as  Flight  Test  Design  and 
Evaluation  and  RV  Antenna  Design  Analysis 
are  required  during  all  program  phases  to 
support  on-going  test  programs.  As  a  result, 
while  Tables  5  through  7  indicate  the 
identification  of  33  sustainment  candidates  in 
the  EMD  phase,  31  in  the  Production  phase, 
and  22  in  O&S  phase,  there  exist  only  44  which 
are  unique. 

A  listing  of  the  selected  Sustainment 
Candidates  is  presented  in  Table  8,  in  which 
they  are  grouped  by  category  (skill,  product/ 
process,  test  or  documentation)  and  by 
program  phase  (EMD,  Production  or  O&S).  In 
this  compilation  some  candidate  grouping  has 
been  developed.  For  instance,  HIPIC  Process 
for  C-C  and  3-D  Graphite  Fiber  Preform 
Weaving  have  been  grouped  as  elements  of  C- 
C  Composite  Nosetip  Billet.  Also,  specific  test 
equipment  (e.g..  Low  Frequency  Instrument 
Console)  has  been  grouped  together  as  Fuze 
Test  Equipment.  The  compilation  contained  in 
Table  8  represents  our  recommended  list  of  RV 
capabilities  that  must  be  sustained  in  order  to 
assure  a  credible  base  for  maintaining  the 
ICBM  fleet. 

5.0  Conclusions 

1.  On  RVAP  we  have  derived  a  set  of 
approximately  one  hundred  ATE's  which 


comprise  the  skills,  products/  processes/ 
materials,  documentation  and  facilities 
necessary  for  conduct  of  the  EMD,  production 
and  OT&E  phases  of  an  ICBM  reentry  system. 

2.  A  process  has  been  developed  to  screen 
the  set  of  ATE's  on  the  basis  of  evaluation 
criteria  of  Uniqueness,  Criticality  and 
Availability/Affordability.  Quantitative  scoring 
criteria  were  developed  and  the  process  was 
exercised  by  our  IPT.  The  process  ranks  ATE's 
into  three  groups:  sustainment  candidates 
("critical  attributes"),  further  review  required  and 
no  action  required  (not  critical). 

3.  Forty-four,  or  about  half  of  the  ATE's 
were  rated  as  sustainment  candidates  or  critical 
attributes  of  the  ICBM  reentry  system  industrial 
base.  Recommendations  have  been  made  for 
sustaining  engineering  work  in  these  areas. 
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TABLE  4:  IDENTIFICA  TION  OF  ALL  ACTIVITY  TREE  ELEMENTS  -  OT&E  PHASE 
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TABLE  5:  CLASSIFICATION  OF  ACTIVITY  TREE  ELEMENTS  -  EMD  PHASE 
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TABLE  6:  CLASSIFICATION  OF  ACTIVITY  TREE  ELEMENTS  -  PRODUCTION  PHASE 
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HEATSHIELD 

•  HARDENED  SILICA  COMPOSITE 
ANTENNA  WINDOW  (e.g.  AD3DQ) 

NOTE  (1):  ALL  PHASES  *  HARDENED  ELECTRONIC  PARTS 

•  NH&S  CRITICAL  MATERIALS  /  PROCESSES 
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CONSOLES 

AGING  AND  SURVEILLANCE  OF  TPS  MATERIALS 
(RAYON-BASED  CARBON  PHENOLIC  HEAT- 
SHIELD  IN  PARTICULAR) 
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FIGURES:  UNIQUENESS  FILTER 


FIGURE  4A:  RVAP  ELEMENT  EVALUATION  FORM 


Prepared  By: 


MARTIN  MARIETTA  ASTRO  SPACE 


□ 

SKILL/rOOL 

□ 

PRODUCT/ 

PROCESS 

□ 

TESTING 
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ACT!  Vll^r  TREE  ElEM  E  NT  IDENTIFfC  A’RON 


Element  Description: 


Check  all  that  apply 

SYSTEM:  □  MK-12A 


Check  all  that  apply 

PHASE:  □  EMD 


r~|  NOT  UNIQUE 
Q  UNIQUE 


□  MK-21  I  I  MM  III  R/S  I  I  MK-12 


n  PROD  □  o&s 


MK-5 


yNIQUEHESS  FILTER 


'  If  “Not  Unique",  Do  Not  Proceed  *  *  *  * 


^RmCALITY  ASSESSMENT 


Criteria 


CRITICALITY 
TO  MISSION: 


PROBABILITY 
OF  NEED: 


CRITICALITY 
TOTAL  SCORE: 


Criteria 


AVAILABILITY: 


LEAD  TIME: 


AFFORDABILITY: 


AVAILABILITY 
TOTAL  SCORE: 


Rationale 


__  AVAILABIUTY  &  AfT^OfmASIllTY  ASSESSMENT 


Rationale 


Total  Criticality  >10  AND  Total  Availabilitv  >  15 


□  SUSTAINMENT 

riAMninATc 


SCORIN<S  RESULTS 


Any  Individual  Criterion  Score  >  8 


□ 


SUSTAINMENT 

CANDIDATE 


ADDITIONAL 
REVIEW  NEEDED 


□  NO  ACTION 


FIGURE  4B:  RVAP  ELEMENT  EVALUATION  FORM 


_ guppuEFi  ^  FAciuTY  m¥mmjm 

Supplier/Test 

Facility(s)  last  used:  Current  Status: 


Alternate 

Supplier(s)/Facility(s):  Current  Status: 


_ AODiTtONAt  (If  reqoir^ _ 

Additional  rationale,  as  needed,  including:  Supplier  quality.  Security  concerns  (personnel/facility  clearances, 
computational  capabilities).  Others  as  determined  by  the  teams. 


CRITICALITY  TO  MISSION 

Assessment  of  the  Activity  Tree  eiement’s  criticaiity  to  the  Mission  of  the  weapon  system.  Dependant  upon 
operationai  requirements  (e.g.,  current  vs  projected  capabiiity,  iife  extension,  targeting,  range,  accuracy,  NH&S, 
Single  RV,  threats,  etc.) 
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